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Abstract — We present the design of an analog circuit which 
solves linear programming (LP) problems. In particular, the 
steady-state circuit voltages are the components of the LP 
optimal solution. The paper shows how to construct the circuit 
and provides a proof of equivalence between the circuit and the 
LP problem. The proposed method is used to implement a LP- 
based Model Predictive Controller by using an analog circuit. 
Simulative and experimental results show the effectiveness of 
the proposed approach. 



I. Introduction 

Analog circuits for solving optimization problems have 
been extensively studied in the past [1], [2], [3]. Our 
renewed interests stems from Model Predictive Control 
(MPC) [4], [5]. In MPC at each sampling time, starting at the 
current state, an open-loop optimal control problem is solved 
over a finite horizon. The optimal command signal is applied 
to the process only during the following sampling interval. 
At the next time step a new optimal control problem based 
on new measurements of the state is solved over a shifted 
horizon. The optimal solution relies on a dynamic model 
of the process, respects input and output constraints, and 
minimizes a performance index. When the model is linear 
and the performance index is based on one-norm or oo-norm, 
the resulting optimization problem can be cast as a linear 
program (LP), where the state enters the right hand side (rhs) 
of the LP constraints. 

We present the design of an analog circuit whose steady 
state voltages are the LP optimizers. Thevenin Theorem is 
used to prove that the proposed design yields a passive 
circuit. Passivity and KKT conditions of a tailored Quadratic 
Program are used to prove that the analog circuit solves 
the associated LP. The proposed analog circuit can be used 
to repeatedly solve LPs with varying rhs and therefore is 
suited for linear MPC controller implementation. For some 
classes of applications the suggested implementation can 
be faster, cheaper and consume less power than digital 
implementation. A comparison to existing literature reveals 
that the proposed circuit is simpler and faster than previously 
published designs. 

The paper is organized as follows. Existing literature is 
discussed in section [fl] We show how to construct an analog 
circuit from a given LP in section III Section IV proves the 



equivalence between the LP and the circuit. Simulative and 
experimental results show the effectiveness of the approach 
in section[V] Concluding remarks are presented in section VI 



II. Previous works 

A. Optimization problems and electrical networks 
Consider the linear programming (LP) problem 
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where [Vi, . . . , V n ) are the optimization variables, A meq and 
A eq are matrices, and c, b eq and 6; neq are column vectors. 

The monogram by J. Dennis [1] from 1959 presents an 
analog electrical network for solving the LP Q. In Dennis's 
work the primal and dual optimization variables are repre- 
sented by the circuit currents and voltages, respectively. A 
basic version of Dennis's circuit consists of resistors, current 
sources, voltage sources and diodes. In this circuit each entry 
of matrices Aj neq and A eq is equal to number of wires that 
are connected to a common node. Therefore, this circuit is 
limited to problems where the matrices A[ neq and A eq contain 
only small integer values. An extended version of the circuit 
includes multiport DC-DC transformer and can represent 
arbitrary matrices A[ neq and A eq . Current distribution laws in 
electrical networks (also known as minimum dissipation of 
energy principle or Kirchoff 's laws) are used to prove that the 
circuit converges to the solution of the optimization problem. 
This work had limited practical impact due to difficulties in 
implementing the circuit, and especially in implementing the 
multiport DC-DC transformer. 

In later work, Chua [6] showed a different and more prac- 
tical way to realize the multiport DC-DC transformer using 
operational amplifiers. In subsequent works, Chua [3], [7] 
and Hopefield [2] proposed circuits to solve non-linear 
optimization problem of the form 



min f{x) 

X 

s.t. gj(x) < 0, j = l...m 



(2) 
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where x S M. n is vector of optimization variables, f(x) is the 
cost function and gj(x) are the m constraint functions. The 
LP ([T]i was solved as a special case of problem Q [3], [2]. 
The circuits proposed by Chua, Hopefield and coauthors 
model the Karush-Kuhn-Tucker (KKT) conditions by rep- 
resenting primal variables as capacitor voltages and dual 
variables as currents. The dual variables are driven by the 
inequality constraint violations using high gain amplifiers. 
The circuit is constructed in a way that capacitors are charged 
with a current proportional to the gradient of the Lagrangian 
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of problem <j2j 



~dt 



df(x) 
dxi 



dxi 



(3) 



where ^ is the capacitor voltage derivative and Ij is the 
current corresponding to the j-th dual variable. The deriva- 



tives an d If 1 are implemented by using combinations 
of analog electrical devices [8]. When the circuit reaches 
an equilibrium, the capacitor charge is constant = 0) 
and equation Q becomes one of the KKT conditions. The 
authors prove that their circuit always reaches an equilibrium 
point that satisfies the KKT conditions. This is an elegant 
approach since the circuit can be intuitively mapped to the 
KKT equations. However, the time required for the capacitors 
to reach an equilibrium is non-negligible. This might be the 
reason for relatively large settling time reported to be "tens 
of milliseconds" for those circuits in [3]. 



B. Applying analog circuits to MPC problems 

The analog computing era declined before the widespread 
use of Model Predictive Control. For this reason, the study of 
analog circuits to implement MPC problems has never been 
pursued. In [9] fast analog PI controllers are implemented on 
an Anadigm's Field Programmable Analog Array (FPAA) 
device [10] for an application involving fast chemical mi- 
croreactor. The analog circuit designed in [9] has a computa- 
tion time faster than a digital controller implementing the PI 
controller. The article briefly proposes to use FPAA for MPC 
without specifying details. To the best of authors knowledge, 
no further work has been published in this direction. 

III. Electric circuit for solving linear 

OPTIMIZATION PROBLEM 

Without loss of generality, we assume that A meq , A eq and c 
have non-negative entries. Any LP may be transformed into 
this form by using a three-step procedure. First, defining a 
new negative and positive variable for each original variable 
V~ + V + = 0, second splitting Aj neq , A eq and c into positive 
and negative parts (A ineq = A^ eq - Ar^, A eq = A+ - A~ 
and c — c + — c~), and third replacing Aneq^, A eq V 
and c T V with A+ eq V+ - A^V, A+V+ - A~V~ and 
c + V + — c~ V~, respectively. 

In the beginning of this section we present the basic 
building blocks which will be lately used to create a circuit 
that solves problem ([TJ. The first basic block enforces 
equality constraints of the form ( fib) . The second building 
block enforces inequality constraints of the form ( fTc) . The 
last basic block implements the cost function. 



A. Equality constraint 

Consider the circuit depicted in Fig. [T] In this circuit n 
wires are connected to a common node. We call this node 




Fig. 2: Equality enforcing circuit. 
N Consists of n resistors Rk, a nega- 

Fig. 1: A node with k tive resistance and a reference volt- 
connected wires age. 




Fig. 3: Inequality enforcing cir- " 
cuit. Fig. 4: Cost circuit 



a, its potential is U and the current that exits this node is I. 
Kirchhoff's current law (KCL) implies 
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Vk-U 



(4) 



where Vk is the potential of node k, Rk is the resistance 
between node k and the node a. Equation Q can be written 
as an equality constraint on potentials Vk' 



E 



= I 



™ 1 



(5) 



k=l k=l 

If we can set the right hand side (rhs) of |5]l to any desired 
value b, then (|5]l enforces an equality constraint on a linear 
combinations of Vk ■ Therefore every equality constraint ( fTb| ) 
can be implemented with a circuit which enforces |5]l and 
implements 

u »-' 



En j_ 
k=l R k 

Equation |6]) together with |5]l yields 

V x 
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Rn 



v„ 



= b. 



(6) 



(7) 



and the circuit implementing |7]) is shown in Fig. [2] 

Remark 1: In the circuit in Fig. [2] the negative resistance 
can be realized by using operational amplifiers. 



B. Inequality constraint 

Consider the circuit shown in Fig. [3] Similarly to the 
equality constraint circuit, n wires are connected to a com- 
mon node a. Its potential is U and the current exiting this 
node is /. Kirchhoff's current law (KCL) implies 



k=l 



k = l 



Rk 



(8) 
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An ideal diode connects node a to node f3. The potential of 
node /3 is U' . The diode enforces U < U' . In Fig. [3] the 
voltage U' can be computed as follows 

b-I 



U' 



> U. 



En _J_ 
k=l R k 

Equation ^ and U < U' yield 

k=l k=l fe=l 

Which can be compactly rewritten as 
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with the diode enforcing 

I> 0, 

I(U-U') = 0. 



(9) 



(10) 



(11) 



(12a) 
(12b) 



By using (|9) and rearranging some terms, equation ( |12b| i can 
be rewritten as: 



0. 



(13) 



C. Cos? function 

Consider the circuit in Fig. [4] In this circuit the potential 
of node a is equal to [/ cost and the current that exits the node 
is J cost . From |5]l we have 



^ — Icost + t^cost 

— ^tfc 



= J. 



(14) 



where c = [1 /Ri ... 1 /R n ] and J is the cost function. 

This part of the circuit implements the minimization of the 
cost function. When [/ cost is set to a low value, the voltages 
Vk are driven to a direction which leads the objective function 
value J to approach the [7 C0St value. However, the cost J 
is different from [/ cost because the current J cost is not zero. 
A detailed explanation on this part of the circuit will be 



presented later in section IV-C 



D. Connecting the basic circuits 

This section presents how to construct the circuit that 
solves a general LP. We construct the conductance matrix 

G <= R( ro+1 ) xn as 



G = 



A 



c 



(15) 
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Fig. 5: Electric Circuit solving a LP. Vertical wires are 
variable nodes with potentials V\ . . . V n . Black dots repre- 
sent resistances that connects vertical and horizontal wires. 
Horizontal wires are cost or constraint nodes. Each horizontal 
wire is connected to a ground via a negative resistance, a con- 
stant voltage source and a diode for inequalities nodes. The 
topmost horizontal wire is the cost circuit and is connected 
to a constant voltage source. 



Consider the circuit shown in Fig. [5] The circuit is 
shown using a compact notation where each resistor Rij is 
represented by a dot, vertical wires represent variables nodes 
with potentials Vi . . . V n and horizontal wires represent con- 
straint nodes. If Gij = then no resistor is present in the 
corresponding dot. This circuit is constructed by connecting 
the nodes associated with the variables V\ . . . V n to all three 
types of the basic circuits: equality, inequality and cost. We 
will refer to such nodes as variable nodes. Each row of the 
circuit in Fig. [5] is o ne of the basic circuits presented in 
Sections \UFA\ \U1-B\ and [TTLCl We claim that, if C/ cost is 
"small enough", then the values of the potentials V\ . . . V n 
in this circuit are a solution of ([TJ. This claim is proven in 
the next section. 

Remark 2: Some of the potentials Vi may be forced ex- 
ternally to a desired value. By doing so, the circuit can solve 
different optimization problems for varying values of those 
potentials. This is equivalent to adding equality constraints 
Vi = bi to (JT| and modifying the value of the equality 
constraint free parameter bi. 

Remark 3: The circuit as shown in Fig. [5] contains no 
dynamic elements such as capacitor or inductance. Therefore, 
the time required to reach steady-state is governed by the 
parasitic effects (e.g. wires inductance and capacitance) and 
by the properties of the elements used to realize negative 
resistance (usually opamp) and diode. Hence, a good elec- 
tronic design can achieves solution times in the order of these 
parasitic effects. This could lead to time constants as low as 
a few nanoseconds. 



and denote G t] the i, j element of G. For a given LP ([T) the IV. ANALYSIS OF THE ELECTRIC CIRCUIT PROPERTIES 



Rij resistor is defined as 



Rj.i = 



1 



-,* = <),. 



,m,j 



1. 



(16) 



where the first row of G (corresponding to c T ) is indexed by 
0. 



In this section we show that the circuit in Fig. [5] with 
Rij as defined by ( [16) , is a solution of the optimization 
problem ([TJ for a range of U cost values. First we derive the 
steady state equation of the electric circuit and then we show 
the equivalence. 
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A. Steady state solution 

Consider the circuit in Fig. [5] Let U = [Ui, . . . , U m ] T be 
the voltages of the constraint nodes as shown on Fig. [5] By 
applying the KCL (Kirchhoff's current law) to every variable 
node with potential V\, . . . , V n we obtain 



G j(f/ C ost - Vj) + (: - ■ {Ui -Vj) = 0, j = \,..., s 



(17) 



which can be rewritten in the matrix form 
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Equation ([18) can be compactly rewritten as 

cU cost + A T U = diag(c T + 1 T A)V 



(18) 



(19) 



where 1 is vector of ones and diag(:r) is a diagonal matrix 
with x on its diagonal. 

Next, we apply KCL on all nodes with potentials 

[E/cost, Ui,...,U m ] to obtain 



^ ' Cj ( C^cost Vj ) — /cost 

.7=1 

n 

Y,Gid{Ui-Vj) = k, i = l, 



, m 



(20) 
(21) 



which can be written in matrix form 
Vi 



A m l 



iN 



Vn 



^cost X^j=l 
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Equation ( |22| > can be compactly rewritten as 

C T V = l T ct/ cost + J ost 

AV = diag (1 T A T ) U + I. 



cost 

I 



(22) 

(23) 
(24) 



The equality voltage regulator law (|6) and the inequality 
law (|9) can be compactly written as 



diag (l T Aj q ) U eq = b eq - I eq 

diag A^ eCi j t/ineq ^ &ineq ~ Aneq ■ 

By substituting d25) into d24b we obtain 



^eq^ — ^eq 
-^-ineq V" ^ineq ■ 



(25a) 
(25b) 

(26) 
(27) 




Fig. 6: An alternative inequality enforcing node. When diode 
is not present, the circuit is an equality enforcing node. 
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Fig. 7: N-port resistor network with ports All iJjj are 
positive resistances, all Rf. are negative resistances. 



Substitution of ( |24) for inequalities to the diode con- 
straint ( fTJ) yields 



(28) 



where I is the set of all inequalities constraints. 

We collect ([19), (f23), (|24), ([26), |27) and {[2a) into one 
set of equations which characterize the circuit 

AV = diag (l T A T ) U + I (29a) 
cC/cost + A T U = diag(c T + 1 T A)V (29b) 

(29c) 
(29d) 
(29e) 

A ineq V - fttaj . [/ineji = 0, Vi € I (29f) 

(29g) 



Aeq^ = ^eq 
^ineq^ — ^ineq 
-Mneq ^ 



C T V — l T cU cost + /cost 5 



where U, I, I cost and V are the unknowns. The voltage of 
the cost node, U co&t , is set externally. 

B. Circuit passivity 

We are interested in showing that the general circuit in 
Fig. [5] is a passive system. First we swap the diode and 
the resistor in Fig. [3] to obtain a basic inequality circuit as 
shown in Fig. [6] It is simple to prove that this swap yields 
an equivalent electric circuit. Next, we examine an N-port 
resistor network that includes all the resistors of the original 
circuit shown in Fig. [5] including the negative resistances, 
but not including the diodes nor the constant voltage sources 
as shown in Fig. [7] The ports of the electric network is the 
set of all nodes marked a in Fig. [6] 
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Fig. 8: Subnetwork that connects nodes i and j, after 
assuming that all other resistors are zero. 



Proposition 1 (Network non-negativity): The resistance 
network in Fig. [7] is equivalent to a resistance network with 
non-negative resistors. 

Proof: [Proof of non-negativity proposition] Our goal is 
to obtain a lower bound of an equivalent resistance between 
any two ports. From Fig. [7] we see that a sub-network that 
connects two ports consists of two negative resistances — 
one for each port, and a mesh of positive resistors between 
them. We want to find an equivalent resistance, that exist 
according to the Thevenin theorem [11]. Let Ui and Uj 
be the two nodes in question. Next, motivated by a fact 
that replacement of any of positive resistances with a zero 
resistance may only reduce the total equivalent resistance, 
we make a conservative assumption that all the resistors 
in this network, excluding resistors directly connected to 
negative resistors of the U and Uj nodes, are zero, thus 
Rk.i = 0,Vfc, I s.t. k i,j. In this case all variables nodes 
have the same potential. This sub-network is illustrated in 
Fig. [8] The equivalent resistance of this network is zero, since 
according to |6]) the negative resistance is constructed to be 
equal to the negative of parallel combination of other node 
resistances. For the [/ cost cost port (which does not have the 
negative resistor), the equivalent resistance is strictly greater 
than zero. Therefore, the equivalent resistance between any 
two ports is at least zero. ■ 



The theorem will be proven in the following way: first we 
claim that the equations ( |29a| )-( |29f] > have a solution when 
no cost function is present (c = 0); second, we show that 
there exists U^ t such that any solution to ( p9| ) is also an 
LP solution; third, we show that for all C/ cost < [/™ s ' t any 
solution to ( |29] l is also an LP solution. 

Consider an electric circuit, that consists of constraint 
sub circuits and no cost sub circuit. This electric circuit is 

0. 



characterized by ( 29a i-( |29f| l with c 

Lemma 1 (Existence of solution to a no-cost circuit): 
Let Assumption [T] hold. Assume that A is no n-negative, 
1 T A > and 1^A T > 0. Then, the equations |29a i-|29f| 
have a solution when c = 0. 



Proof: First we rearrange (29ai-(29fi. Equation ( |29a[ ) 
can be split into an equality and inequality parts 



A eq = dia K (l T Aj n ) U 



Ainea = diae (1 A 



T A T 



u* 



iineq — \± ^-ineq; "-^lneq ~ -Mneq- 

Equation ( |29b| > can be rewritten as 

4f q £4 q + Aneq^neq = diag (l T A) V. 

Therefore, (|29a|i-(|29f|) can be written as 



A eq V = diag (l T A e T q ) U eq + Zeq 

^-ineq^ = diag (l T A^^ U\ aeq + 7; neq 

A^U eq + Af neq U ineq = diag (1 T A) V 



^eq^ — ^eq 
-^-ineq^ — ^ineq 
-Mneq ^ 



(^ineq^ ~~ ^ineq)^ Aneq^ — : Vz E X. 



(30) 
(31) 



(32) 



(33a) 
(33b) 
(33c) 
(33d) 
(33e) 
(33f) 
(33g) 



Next, consider the following quadratic program (QP) 



C. Equivalence of the optimization problem and the electric 
circuit 

We consider the following assumptions. 

Assumption 1: The LP ([T]i is feasible and that the set of 
primal optimal solutions is bounded. 

Assumption 2: The dual of LP ([T| is feasible and that the 
set of dual optimal solutions is bounded. 

Assumption 3: In the LP (fTJ, G is non-negative, 1 T G > 
and 1 T G T > 0. 

Theorem 1 (circuit equivalence): Let Assumptions 
hold. Then, there exists U^ t , such that a solution V* to 
is also an optimizer of the LP |T} for all U cost < U^ t . 

Remark 4: As explained earlier, the assumption on the 
non-negativity of G in Theorem [T] is not restrictive. Also, 
1 T G > and 1 T G T > are always satisfied for LP 
problems without zero rows or zero columns. 

Remark 5: In Theorem[T]we require that the sets of primal 
optimal and dual optimal solutions are bounded. This can be 
guaranteed if the primal feasible set is bounded and linear 
independent constraint qualification (LICQ) holds. 



min V 1 QV 

v 

s.t. A eq V = b eq 

^ineq ^ — ^ineq j 



(34a) 
(34b) 



This problem has a finite solution for any Q because the 
feasibility domain is bounded and not empty. The value of Q 
will be selected later. We use this problem to find a solution 
to (29ai-d29f}. KKT is a necessary optimality condition for 



problems with linear constraints (Theorem 5.1.3 in [12]), 
therefore, there exist V*, /i*, A* which satisfy the KKT 
conditions 



Aj q p* + Al eq X* + QV* = 



ineq 



^eq^ — ^eq 

4 V* < h 
-^Mneq v _ u ineq 



A* > 

(^lineq^ 



frineqM* =0, 1 £ 1, 



(35a) 
(35b) 
(35c) 
(35d) 
(35e) 



where p* and A* are the dual variables. 
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We choose Q and use /i*, A* and V* to compute £7* 



Ai 



A„ 



Q = diag (l T A) - A e T q diag (l T A T ' 



A 



eq 



A? diag (1 T A? 



ineq 



ineq ) 



A 



ineq 



I* 

eq 

u* 

eq 

I* 

ineq 

u* 

w ineq 



:diag(l T A e T q ) M ' t 



:diag(l T A e T q ; 
:diag(l T ^ eq ) A* 
:diag(l T ^ eq 

Note that diag ^l T A^ eq ^ and diag ^l T A^ eq ^ are invertible 
and positive from the assumptions of Lemma [JJ Equa- 
tions ( [36) are combined with ( |3"5) to get 



A^V* 



A\ ne q V 



X*. 



eq' 



(36a) 
(36b) 
(36c) 
(36d) 
(36e) 



A^V* = 

AineqV 

A^K 4 
A eq V* = 



diag (\ T A T eq ) £/* 



r 



T /iT 



= diag (1 J A 
A T U* 

ineq ineq 



ineq 

diag 



£/•* 

ineq 



ineq 

"A) y* 



'eq 



Aineq^ ^ineq 
^meq > 



i^ineq,- — 0, 2 G X. 



(37a) 
(37b) 
(37c) 
(37d) 
(37e) 
(37f) 
(37g) 



Equations ( |3"7) have a solution and are identical to ([33). 
Therefore, there exist V*, U* and 7* solving (f29a]i-([29f|) 
when c = 0. ■ 
Our next goal is to show that there exists a U cost such 
that circuit solution is also an LP ([T) solution. To show this 
we concatenate the primal problem ([T) with a corresponding 
dual problem [13] 



max b T A 

A 

s.t. [A? Al eq }\ = c 
[0 I m ] A > 0, 



(38a) 

(38b) 
(38c) 



where Im is an identity matrix of size equals to number 
of inequality constraints. We create the following feasibility 
problem 



min 

X,v 

s.t. A eq V 



^eq ? -^ineq ^ — ^ineq 



Al eq }\ = c, [0 l m ] A > 
c T V + b T X + 6lA_ =0, A + A_ = 0, 



(39a) 

(39b) 
(39c) 
(39d) 



where b + and 6_ are the absolute values of the positive 
and the negative components of b and A_ equals to — A. Note 
that ( |39d| > is equivalent to c T V = b T X. 

Remark 6: From the Assumption [3] and from the structure 
of ( |39d| i, it follows that the matrix of equality and inequality 
constraints has non-negative coefficients and non-zero rows 
and columns. 

All feasible points of problem ([39| are primal ([T| and 
dual ( |3~8| l optimal solutions [13]. 

Problem ( j39] l is solved by the circuit shown in Fig. [9] This 
circuit contains two parts: the primal and the dual circuits, 
each has the general form as in Fig.|5]and consists of equality 



Dual 



[0 M 
A 1 ' 




Fig. 9: Circuit that implements the primal-dual feasibility 
problem. Primal and dual constraints are separated. Primal 
and dual parts are connected only via zero duality gap 
constraint. For compactness, b + and 6_ are represented as b 
and A_ is embedded in A. 



and inequality sub circuits corresponding to constraints of the 
primal and dual problems. Note that no cost circuit is present 
in the primal and in the dual circuit. Instead, those circuits 
are connected by equality sub circuit that corresponds to the 
zero duality gap constraint ( |39d| >. 

Proposition 2: Let Assumptions [T|3] hold. The circuit in 
Fig. [9] admits a solution. Moreover, for any circuit solution, 
the voltages V of the variable nodes are a solution to the 
original LP ([l}. 

Proof: The circuit in Fig.|9]consists only of equality and 
inequality sub circuits. As shown in sections |III-A| and |III-| 
[B] the variable nodes voltages must satisfy the associated 
equality or inequality constraints and thus equations ([39). 
The feasible set of problem ( |39| ) is the set of all primal 
optimal and dual optimal variables of problem ([TJ. This 
feasible set is bounded by assumption. This fact and the 
results from Remark [6] imply that all the assumptions of 
Lemma Q] are satisfied. We conclude that the circuit admits 
a solution. Moreover, every solution must be a solution of 
the original LP ([TJ, because it satisfies simultaneously dual 
and primal problems with zero duality gap [13]. ■ 
In the circuit shown in Fig. [9| the dual and the primal 
circuits are connected with a single wire that has some 
voltage when the circuit settles. We call this voltage L^ c " t *- 

hold. 



Lemma 2 (Exists [/,?"/ )■' Let 



rj3 



= £/c C os, is an 



Assumptions 

Consider the circuit in Fig. [5] and its corresponding equa 
tions ([29). A solution V* to ([29) with U mst 
optimizer of the LP ([T). 

Proof: If a voltage equals to U^ t is applied externally 
to the wire that connects the primal and the dual parts (at 
point a in Fig. |9), we can remove the dual circuit without 
affecting the primal one. Therefore, the circuit in Fig. [5] 
admits the same solution as the primal circuit in Fig. [9] ■ 
To complete the proof of Theorem [TJ we need to show 
that for any voltage U cost < J7 c c " t * the circuit will continue to 
yield the optimal solution. Assume that U cost is perturbed by 
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A£7 cost from the value [/ c c ™ t *- We denote perturbed values 
in variable voltages V and the cost current J cost as AV 
and AI mst . Next, we examine the Thevenin equivalent resis- 
tance [11] as seen from the cost node. From Proposition[T]we 
already know that this resistance is non-negative, but more 
can be said for the cost node. Refer to Fig. [8] showing a 
subnetwork connecting two arbitrary nodes. When one of the 
nodes is the cost node, it does not have one of the negative 
resistances, therefore, the the total resistance, i?totab which 
can be seen from this node is at least all the cost resistances 
in parallel 

fltotai > ^ • (40) 



From ( 29g i follows that 



c-AV= £, 



ALL, 



AL, 



v»=l 



Using the total equivalent resistance we know that 

At/cost 



R 



total 



Combination of (|4TJ, (|42) and ((40]) yields 

c T AV 1 



AU a 



i=l 



> 0. 



(41) 



(42) 



(43) 



The equation ( |43| ) states that the change in cost value must 
have the same sign as the change in Af7 cost . Therefore, 
when [/ cost is decreased the cost must decrease or stay 
the same. However, the cost cannot decrease, since it is 
already optimal. Therefore the cost must remain constant, 
and the circuit holds solution to the problem ([T]) for any 
U cos t < t^cost'- TW S resu lt completes the proof of Theorem u\ 

V. Example applications and experimental 

RESULTS 

This section presents three examples where the approach 
proposed in this paper has been successfully applied. In the 
first example an LP is solved by the proposed electrical 
circuit simulated by using the SPICE [14] simulator. In the 
second example an analog LP is used to control a linear 
system by using Model Predictive Control. In the third 
example an experiment is conducted by realizing the circuit 
for a small LP with standard electronic components. 

A. Linear Programming 

We demonstrate capability of the method by solving an 
LP problem. The problem is a randomly generated and it 
has 120 variables, 70 equality constraints and 190 inequality 
constraints. In order to simulate parasitic effects of real 
circuit inductance values of lQOnH are assumed for the 
wires, that roughly corresponds to inductance of 10 cm long 
wire. 

The convergence of the electric circuit is shown in Fig. [10] 
The time scale in this example is determined by the selected 
value of parasitic inductance. The circuit transient can be 
partitioned to two phases. During the first 200/is rapid 
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Fig. 10: Example of LP solution. The upper plot shows 
solution variables in time. The lower plot shows the cost 
function value. 



convergence to a solution close to the optimal one can be 
observed. Afterwards, at about 500/is the circuit converges to 
the true optimum value. Typical accuracy achieved in analog 
electronics is in the order of 0.5% of the dynamic range. The 
longer convergence time is not of practical interest, because 
the difference between the immediate cost value and the true 
optimal one is less than the accuracy that is expected from 
analog devices. 

B. MPC example 

This example demonstrates the implementation of a model 
predictive controller with an LP analog circuit. For this 
example we work with the dynamical system % = — x + u, 
where x is the system state and u is the input. We want x 
to follow a given reference trajectory, while satisfying input 
constraints. The finite time optimal control problem at time 
t is formulated as 



N 



min \x(i) - x re t(i)\ 

. f ' 



(44a) 



Xi+i =Xi + (ui - Xi)S, i = 0, . . . , N (44b) 
- 1.5 < Ui < 1.5, i = 0, . . . , N (44c) 
x Q = x(t) (44d) 

where N is the prediction horizon, x re f(i) is the reference 
trajectory at step i, S is sampling time and x(t) is the initial 
state at time t. Only the first input, uo, is applied at each 
time step t. 

With N = 16, the LP in |44| has 96 variables, 63 equality 
constraints and 49 inequality constraints. An electric circuit 
that implements system dynamics together with the circuit 
that implements the MPC controller were constructed and 
simulated using SPICE. The voltage value representing the 
system state was measured and enforced on the xo node of 
the LP. The optimal input value uq was injected as input 



to the simulated system dynamics. Fig. 1 1 shows the closed 



loop simulations results. Notice the predictive behavior of the 
closed loop control input and the satisfaction of the system 
constraints. 

In order to demonstrate system performance for imperfect 
analog devices, another simulation result with 1% random 
Gaussian error in values of resistors is presented on the same 



Fig. 1 1 There is no significant change in system behavior. 



8 




time [s] 

Fig. 11: Example of MPC implementaion. Solid lines rep- 
resent nominal controller, dashed lines represent controller 
implemented with random 1% error of analog devices. 

TABLE I: Experimental and theoretical results (in parenthe- 
sis) for LP solution. 



cost direction 


xl (exact) 


x2 (exact) 


1 1 


4.996 (5.0) 


4.99 (5.0) 


-1 1 


7.002 (7.0) 


5.005 (5.0) 


-1 -1 


-7.012 (-7.0) 


-4.98 (-5.0) 


1 


6.976 (7.0) 


0.005 (0.0) 



C. Hardware implementation example 

We implemented a small LP using standard electronics 
components. The same problem was realized by Hopfield [2] 
and Chua [3]. The LP is defined as follows 

Tr lT 

mm c \x\ 22 

x ly x 2 

5 35 r nr 

S.t. —Xl - X 2 < —, + X * - T 

-Xl < 5, x 2 < 5 (45) 

where c is a cost vector, that is varied to get different 
solution points. The circuit was realized using resistors of 
1% accuracy, operational amplifiers (OP27) for the negative 
resistance and comparator (LM311) together with the switch 
(DG201) to implement functionality of an ideal diode . 

Various values for the cost function c and test results are 
summarized in Table [I] Table [I] shows that the experimental 
results are accurate up to 0.5%. The circuit reaches an 
equilibrium 6 [is after the cost voltage was applied. The 
convergence time is governed by a slew rate of the OP27 
that is limited to 2.8 V/ /is. 

VI. Conclusion 

In this paper we presented an approach to design an 
electric analog circuit that is able to solve a feasible Linear 
Program. The method is used to implement and solve MPC 
based on linear programming. We present simulative and the 
experimental results that demonstrate the effectiveness of the 
proposed method. 

The reported LP solution speed of 6 fis is faster than 
any result that was previously reported in the literature, 
and may be significantly decreased further by selecting 
faster components or implementing the design using faster 
technology, such as custom VLSI design or FPAA device. 



The circuit analysis is at steady state. The theory of 
Linear Complimentary system [15] can be used to study 
the dynamic circuit behavior. This is a subject of ongoing 
research. Future research directions include solution of larger 
problems, possible expansion the method to solution of 
quadratic programming (QP) and solutions to the optimal 
circuit design. 
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